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CHAPTER  I 


INTRODUCTION 


The  limitations  of  the  human  when  operating  as  part  of  a 
control  system  are  becoming  more  apparent  every  day.   Today 
many  control  systems  are  so  complex  and  require  such  fast 
response  times  that  the  human  does  not  possess  the  ability 
to  operate  them.   In  many  cases  the  human  operator  can  be 
eliminated  completely  from  the  system,  but  for  the  most  part 
the  intelligence  of  the  human  is  required  within  the  system. 
Therefore,  engineers  today  have  the  problem  of  determining  what 
the  human  operator  car.  control.   This  problem  has  prompted  con- 
siderable research  in  the  area  of  human  behavior  in  control 
systems. 

Research  in  this  area  was  started  in  1962  by  the  Psychology 
Department  at  Kansas  State  University  with  the  conception  of  the 
VETA  (Versatile  Electronic  Tracking  Apparatus)  system.   The  VETA 
system  was  documented  (Trumbo,  1963),  and  the  original  purpose 
of  the  system  has  been  retained  in  the  system  presently  used; 
however,  many  improvements  have  been  made.   The  system  is  now 
called  the  Motor  Skills  system.   A  brief  discussion  of  this 
system  will  be  presented  at  this  time  to  familiarize  the  reader 
with  its  main  objectives.   A  complete  description  of  the 
Motor  Skills  system  will  be  given  later  in  the  thesis. 

The  Motor  Skills  system  creates  a  tracking  task  to  which 
a  subject  or  operator  can  respond.   The  tracking  task  is  in 


the  form  of  a  1/2  inch  vertical  line  which  moves  horizontally 
on  an  oscilloscope.   This  line  is  displayed  to  the  subject, 
and  the  horizontal  movement  of  the  line  is  controlled  by  the 
system.   This  line  is  called  the  target.   Another  line,  the 
cursor,  is  displayed  below  the  target.   The  cursor  is  also  a 
1/2  inch  vertical  line  which  moves  horizontally,  but  the 
cursor  is  controlled  by  an  arm  control.   In  this  way  the 
Motor  Skills  system  can  present  the  tracking  task  by  moving 
the  target,  and  the  operator  can  respond  by  trying  to  keep 
the  cursor  lined  up  with  the  target. 

The  main  deficiency  of  the  Motor  Skills  system  is  in  the 
scoring  of  the  human  operator.   The  system  gives  an  integrated 
error  score  (IES)  which  provides  the  continuous  error  accrued 
by  the  operator  during  a  tracking  task.   The  IES  alone  does 
not  give  enough  information  to  score  the  performance  of  the 
operator.   In  the  past  the  position  of  the  target  and  cursor 
was  displayed  on  Visicorder  records  to  obtain  more  information. 
The  scoring  of  these  records  was  accomplished  by  a  clerk  hand 
scoring  them.   This  was  a  long  and  laborious  task  and  in  many 
cases  called  for  the  scorer  to  make  a  judgement  on  the  relative 
scores  obtained.   For  this  reason  research  on  the  scoring  of 
the  human  tracker  was  requested  and  supported  by  the  Psychology 
Department  at  Kansas  State  University. 

To  obtain  a  general  scoring  procedure  a  decision  was 
made  to  uje  the  facilities  of  the  IBM  360  computer  which  was 
available  on  campus.   The  first  objective  was  to  place  the 


data  in  some  form  so  it  could  be  read  into  the  computer.   The 
data  obtained  from  the  Motor  Skills  system  was  in  the  form  of 
two  analog  signals.   One  of  these  signals  was  from  the  target 
and  the  other  from  the  cursor.   The  amplitudes  of  the  signals 
were  a  function  of  the  positions  of  the  target  and  cursor. 
These  signals  were  then  quantized  with  an  analog  to  digital 
converter,  and  the  quantized  points  were  then  placed  on  mag- 
netic tape  in  a  format  which  could  be  read  by  the  computer. 

A  computer  program  was  written  to  measure  the  same  indices 
which  were  obtained  from  hand  scoring.   This  program  obtained 
the  indices,  but  it  was  restricted  to  the  quality  of  tracking 
which  could  be  accurately  scored. 

The  tools  of  communication  theory  were  checked  to  see  if 
accurate  results  which  were  independent  of  the  quality  of  the 
tracker  could  be  obtained  from  them.   The  cross  correlation 
of  the  target  signal  with  the  error  signal  gave  information 
about  the  relative  error  which  occurred  before  and  after  a 
change  in  the  target  signal.   Another  function,  referred  to 
as  EAE ,  shows  the  average  error  accrued  about  a  change  in  the 
target  signal.   From  this  several  conclusions  were  obtained 
pertaining  to  some  equipment  which  could  be  implemented  into 
the  Motor  Skills  system  to  obtain  better  scores  on  the  human 
tracker. 


CHAPTER  II 


DESCRIPTION  OF  APPARATUS 


The  apparatus  used  in  this  study  consisted  of  the  Motor 
Skills  system  and  the  analog  to  digital  conversion  equipment. 
The  Motor  Skills  system  provided  a  tracking  task  which  was 
presented  to  several  students  who  volunteered  to  participate 
as  subjects.   The  data  collected  from  the  Motor  Skills  system 
was  recorded  in  analog  form  on  a  magnetic  tape  recorder. 
Therefore,  to  score  this  data  on  a  computer  the  analog  to 
digital  conversion  equipment  was  used  to  convert  this  data 
into  digital  information.   A  discussion  of  these  two 
systems  follows. 
A.   MOTOR  SKILLS  SYSTEM 

The  Motor  Skills  system  presents  a  tracking  task  by  dis- 
playing two  vertical  lines  on  an  oscilloscope.   One  of  these 
lines  is  the  target  and  the  other  line  is  the  cursor.   The 
horizontal  movement  of  the  target  is  read  into  the  system  on 
paper  tape.   Two  types  of  target  movements  can  be  presented 
by  the  system  and  are  referred  to  as  the  step  and  ramp  tracking 
tasks.   For  the  step  tracking  task  the  target  can  move 
instantaneously  to  one  of  fifteen  different  horizontal  posi- 
tions on  the  face  of  the  oscilloscope.   When  the  ramp  tracking 
task  is  presented,  the  target  moves  horizontally  across  the 
face  of  the  oscilloscope  at  one  of  seven  different  velocities 
in  either  direction.   The  horizontal  movement  of  the  cursor 


is  controlled  by  a  response  lever.   During  one  trial  of  an 
experiment  a  series  of  target  movements  are  displayed  to  the 
subject.   The  subject  then  trier,  to  follow  the  target  by 
moving  the  response  lever  in  such  a  way  as  to  keep  the  distance 
between  the  target  and  cursor  at  a  minimum.   The  absolute 
value  of  the  distance  between  the  target  and  cursor  is  inte- 
grated over  one  trial,  and  the  final  value  of  this  integration 
is  referred  to  as  the  integrated  error  score.   The  inputs  to 
the  oscilloscope  which  control  the  position  of  the  target  and 
cursor  are  called  the  target  signal  s(t)  and  cursor  signal 
c(t).   The  voltage  of  these  signals  at  any  time,  t,  is  a 
function  of  the  position  of  the  target  and  cursor.   The  target 
and  cursor  signals  are  recorded  on  an  FM  tape  recorder  to 
facilitate  future  scoring  of  the  subjects.   A  simplified  block 
diagram  of  the  Motor  Skills  system  is  shown  in  Figure  1.   The 
main  parts  of  the  Motor  Skills  system  are:   the  system  control, 
a  digital  to  analog  converter,  the  display,  a  response  lever, 
the  scoring  unit.:,  and  the  analog  data  recorders. 

The  Motor  Skills  system  is  controlled  by  a  Digitronics 
Model  2500  paper  tape  reader.   The  tape  reader  is  an  eight- 
channel,  photoelectric  reader.   The  reader  has  a  photoelectric 
cell  for  each  channel  to  sense  whether  or  not  the  channel  has 
a  hole  punched  in  the  tape.   A  hole  condition  implies  that 
a  hole  is  punched  in  the    tape,  and  a  no-hole  condition  implies 
there  is  net  a  hole  punched  in  the  tape.   Each  time  the  tape 
reader  reads  the  tape  it  reads  one  frame,  and  at  t.a  output 


of  each  channel  it  presents  0  volts  for  a  no-hole  condition 
and  -12  volts  for  a  hole  condition.   The  tape  reader  is 
driven  by  a  Tektronix  Type  162  pulse  generator.   The  tape 
reader  steps  to  the  next  frame  each  time  it  receives  a  pulse 
from  the  pulse  generator.   The  first  four  channels  of  the 
reader  are  used  to  control  the  position  of  the  target  which 
is  the  main  tracking  task.   Channels  5-8  are  used  to  control 
secondary  tasks  and  initiate  a  rest  interval.   Since  the  main 
tracking  task  is  the  only  part  considered  in  this  thesis, 
outputs  for  channels  1-4  of  the  tape  reader  are  the  only  ones 
shown  on  Figure  1. 

The  target  is  displayed  on  an  oscilloscope  so  the  outputs 
of  the  paper  tape  reader  must  be  converted  to  a  voltage.   To 
obtain  this  a  simplified  digital  to  analog  (D/A)  converter 
is  used*   The  D-A  converter  consists  of  electronic  switches 
ES^,  ES,. ,  ES,»  ES,8  and  a  summing  amplifier  (or  integrator) 
AI-lo   Channels  1-4  of  the  tape  reader  drive  electronic 
switches  ES   through  ES,  which  switch  +1  volt,  +2    volts, 
+4  volts  and  +  8  volts  respectively.   These  switches  were 
designed  so  each  output  would  be  the  selected  voltage  for  a 
hole  condition  and  zero  volts  for  a  no-hole  condition.   These 
voltages  along  with  -7  volts  are  placed  at  the  inputs  to  the 
summing  amplifier  (or  integrator)  AI-1.   Switch  S   selects 
which  function  AI-1  is  to  perform.   The  operational  amplifier 
used  for  AI-I  is  a  Philbrick  Model  P2  diffsrential  operational 
amplifier j 
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Figure  1    Elock  diagram  cf  the    Motor  Skill 


s  system 


If  switch  S„  is  in  the  summing  amplifier  position  (STEP)  , 
the  output  voltage  s(t)  is 

s(t)  «  -  [-  7  +  ES  (1)  +  ES2(2)  +  ES3(4)  +  ES4<8)]  volts 

where  ES  .  (V.)  implies  that  the  value  is  either  V   or  zero 

depending  on  the  state  of  switch  ES  .   The  minus  sign  describes 

the  inversion  obtained  from  the  summing  amplifier.   Then 

4 
s(t)  -  7  -  Z   ES.CV  )  volts  (1) 

where  V   =  2   '  volts.   This  output  voltage  is  a  series  of 
step  voltages  where  the  voltages  are  selected  by  the  tape 
reader. 

The  photoelectric  cells  in  the  tape  reader  read  the 
tape  at  all  times.   This  includes  the  time  between  frames. 
Between  the  frames  the  tape  is  blank  (no  holes)  so  the  output 
voltage  of  the  D-A  converter  goes  to  +7  volts.   The  time  it 
takes  the  tape  reader  to  jump  from  one  frame  to  the  next  is 
approximately  3  milliseconds.   This  causes  the  target  signal 
s(t)  to  contain  a  3  millisecond  7  volt  pulse  each  time  the 
tape  reader  reads  a  new  frame.   The  human  eye  cannot  detect 
this  pulse  when  the  target  signal  is  displayed  to  the  subjects, 
but  it  is  still  present  in  the  target  signal.   Later  in  this 
thesis  a  reference  will  be  made  to  high-level  noise  in  the 
target  signal.   This  high-level  noise  will  refer  to  these  3 
millisecond  pulses. 


If  switch  S   is  in  the  integrator  position  (RAMP),  the 
output  voltage  is 


s(t)  -  /  [7-1   ES.(V.)  ]  dt  volts. 

0       i=l    i  X 

If  one  frane  read  by  the  tape  reader  is  considered, 

4 
s(t)  =  V   +    7-1   ES.(V.)  1  t  volts  (2) 

1-1    *   X 

where  V   is  the  output  voltage  present  at  the  time  the  frame 
o 

is  read.   This  output  voltage  is  a  series  of  ramp  voltages 
where  the  slope  of  the  ramp  voltages  is  controlled  by  the 
tape  reader. 

The  display  for  the  system  is  obtained  from  a  Tektronix 
Type  561A  oscilloscope  with  two  Type  3A72  dual-trace  amplifier 
units.   In  this  way  the  oscilloscope  is  essentially  an  X-Y 
oscilloscope.   A  high  frequency  sine  wave  is  placed  at  the 
vertical  inputs  of  both  channels.   This  creates  a  vertical 
line  for  each  trace.   The  vertical  amplifier  unit  is  then 
adjusted  to  make  the  lir.es  1/2  inch  long  with  the  two  lines 
overlapping  1/8  inch.   The  target  signal  s(t)  and  the  cursor 
signal  c(t)  are  connected  to  the  horizontal  amplifier.   The 
target  is  connected  to  channel  one,  and  the  cursor  is 
connected  to  channel  two.   In  this  way  the  target  is  displayed 
on  the  top  trace,  and  the  cursor  is  displayed  on  the  bottom 
trace. 

The  response  lever  is  a  lateral  armrest  wh:.ch  pivots 
at  the  elbow.   Connected  to  this  lever  is  a  Helipot  potentio- 
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meter.   The  potentiometer  is  shown  schematically  as  R   in 
Figure  I,   The  output  of  the  center  tap  of  the  potentiometer 
is  the  cursor  signal  c(t). 

To  obtain  the  integrated  error  score,  c(t)  is  inverted 
by  A-l  arid  fed  into  A-2  along  with  s(t).   The  output  of  A-2 
is  c(t)  -  s(t).   Inverter  A- 3  along  with  diodes  Dl  and  D2 
take  the  absolute  value  and  have  an  output  |c(t)  -  s(t)|. 
The  absolute  value  is  then  fed  into  integrator  1-1  which 
integrates  the  error  over  one  trial.   The  integrated  error  is 
then  read  out  by  a  voltmeter.   The  integrated  error  score 
(IES)  is 

IES  =  /|c(t)  -  s(t)  I  dt.  (3) 

The  time  of  integration  is  controlled  by  the  tape  reader 
channel  used  to  initiate  a  rest  interval  and  by  two  timers 
which  are  not  shown  in  Figure  1.   When  a  rest  interval  is 
initiated  after  a  trial,  the  first  timer  starts  timing;  the 
tape  reader  stops;  and  the  input  to  integrator  1-1  is  set 
to  zero  volts.   During  this  time  interval  the  IES  is  recorded. 
When  the  first  timer  stops,  the  second  timer  starts;  and 
during  this  interval  the  integrator  1-1  is  cleared.   When  the 
second  timer  stops,  a  new  trial  begins;  the  tape  reader 
starts;  and  the  integrator  1-1  starts  integrating  again.   The 
operational  amplifiers  used  for  A-l,  A-2,  A-3  and  1-1  are 
Philbrick  Model  K2W  operational  amplifiers  stabilized  by  Model 
K2P  stabilizing  amplifiers* 
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The  analog  recording  of  the  data  is  performed  by  first 
sending  the  cursor  signal  c(t)  through  A-4,  a  Philbrick  Model 
PP55AU  amplifier,  which  is  a  non-inverting  amplifier  used  as 
a  buffer  to  prevent  any  loading  on  the  output  of  R  .   The 
target  and  cursor  signals  are  then  recorded  on  a  Honeywell 
Model  8100  FM  recorder  and/or  a  Honeywell  Model  906c  Visi- 
corder  depending  on  which  type  of  recording  is  desired. 
Generally  the  FM  recorder  is  used  because  Visicorder  records 
can  be  obtained  from  the  FM  recorder  at  a  later  time. 

B.  ANALOG  TO  DIGITAL  CONVERSION  EQUIPMENT 

The  analog  to  digital  (A/D)  conversion  equipment  takes 
an  analog  input  and  samples  it  at  a  fixed  rate.   Each  sample 
is  then  quantized  and  converted  into  a  digital  code  which 
corresponds  to    the  voltage  of  the  analog  signal  at  the  time 
of  the  sample.   This  digital  code  is  recorded  on  a  digital 
tape  recorder  so  the  samples  can  be  read  into  the  IBM  360 
computer  for  further  data  processing.   A  complete  description 
of  the  A-D  conversion  equipment  was  presented  in  a  thesis  by 

C.  H,  Hightower  (1968)  so  the  following  discussion  on  the 
equipment  wj.11  be  brief. 

The  A/D  conversion  equipment  consisted  of  a  Remington 
Rand  Univac  (Phase  II)  Athena  computer,  a  Texas  Instruments 
Model  848  A/D  converter  and  multiplexer,  and  a  Digi-Data 
Model  DSR  1420  digital  tape  recorder.   The  Athena  computer 
was  used  to  control  the  A/D  converter  and  tape  recorder,  store 
data  and  transfer  data.   The  Athena  computer  was  not  used  to 
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process  the  data  because  the  storage  capacity  of  the  Athena 
is  limited  to  256  24-bit  words  which  was  too  small  for  the 
data  processing  performed.   The  A/D  converter  and  multiplexer 
can  sample  up  to  25,000  times  per  second  and  multiplex 
sixteen  different  channels.   Only  two  of  the  channels  were 
usjd  for  this  study,  one  for  the  target  signal  and  one  for 
the  cursor  signal.   The  Athena  computer  was  programed  to 
select  which  channel  would  be  sampled  and  the  time  at  which 
the  sample  would  occur.   When  the  A/D  converter  samples  a 
selected  channel,  it  quantizes  the  input  voltage  and  at  the 
output  presents  this  quantized  sample  in  a  digital  code.   This 
digital  code  can  then  be  transferred  by  the  Athena  to  the ^ 
digital  recorder. 

To  convert  the  analog  data  to  digital  form,  the  target 
signal  s(t)  and  cursor  signa"  c(t)  were  fed  from  the  FM  analog 
recorder  into  the  A/D  converter  on  channels  one  and  two 
respectively.   The  Athena  computer  was  programed  to  command 
the  A/D  converter  to  sample  channels  one  and  two  with  a  time 
of  120  microseconds  between  samples.   The  Athena  then  sent 
these  digitized  samples  to  the  digital  recorder  to  be  recorded. 
This  process  was  repeated  every  50  milliseconds  which  gave  a 
sampling  rate  of  20  times  per  second.   Since  the  time  between 
the  target  sample  and  the  cursor  sample  was  only  120  micro- 
seconds j,  any  future  reference  to  these  samples  will  assume 
that  they  occurred  simultaneously,  and  one  sample  point  will 
refer  to  both  the  target  and  the  cursor  samples. 


13 


After  the  data  was  placed  on  digital  tape,  the  data  was 
read  into  the.  IBM  360  computer.   The  computerized  scoring 
procedures  to  be  discussed  in  this  thesis  were  performed  by 
the  IBM  360  computer. 
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CHAPTER  III 


c-  n::c 


Before  a  computerized  scorii  g      ,i    can  be  discussed, 
a  description  of  the  scoring  method  previously  used  is  needed. 
As  stated  before  the  Motor  Skills  3ystem  gives  an  I2S  which 
is  the  total  error  accrued  by  the  subject  for  one  trial,  but 
to  score  the  subject,  information  on  what  caused  a  certain 
IES  is  needed.   To  obtain  this  information  the  Psychology 
Department  recorded  the  target  signal  s(t)  and  cursor  signal 
c(t)  for  the  step  tracking  task  on  Visicorder  records.   Then 
a  clerk  took  the  record  for  each  trial  and  hand  scored  it. 
To  help  describe  this  hand  scoring  method  a  small  section  of 
a  Visicorder  record  is  reproduced  in  Figure  2,  and  each  index 
described  will  be  applied  to  Figure  2. 

The  position  scale  on  Figure  2  is  from  -3  zo   +3  units. 
The  units  are  not  defined  on  Figure  2  so  an  explanation  is 
necessary.   The  inputs  to  the  oscilloscope  in  the  Motor  Skills 
system  for  the  target  and  cursor  signals  have  maximum  values 
of  -7  volts.   The  oscilloscope  is  adjusted  to  display  the 
target  and  cursor  in  the  center  of  the  CRT  for  an  input  of 
zero  volts j  four  centimeters  to  the  right  of  center  for  an 
input  of  +7  volts,  and  four  centimeters  to  the  left  of  center 
for  an  input  of  -7  volts.   On  Visicorder  records  +3  units 
or.  the  position  axis  corresponds  to  +7  volts  input  to  the 
oscillo       3r  .cans  the  target  or  cursor  is  displayed  four 
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Figure  2. 


centimeters  to  the  right  of  center  on  the  CRT,  and  -3  units 
corresponds  to  -7  volts  input  to  the  oscilloscope  or  means 
the  target  or  cursor  is  displayed  four  centimeters  to  the  left 
of  center  on  the  CRT.   An  actual  Visicorder  record  has  five 
subdivisions  for  each  division  on  the  position  axis  shown 
in  Figure  2  and  ten  subdivisions  for  each  division  on  the  time 
axis.   All  measurements  made  by  the  Psychology  Department 
were  in  terms  of  these  subdivisions.   Therefore,  one  unit  of 
distance  measured  on  the  position  axis  by  the  Psychology 
Department  is  equal  to  .467  volts  input  to  the  oscilloscope 
or  „267  centimeters  displacement  on  the  CRT.   One  unit  of 
measured  time  is  equal  to  .1  second.   The  accuracy  of  the 
msaj  uremeats  was  to  the  nearest  1/2  subdivision  on  the 
Visicorder  record. 
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In  discussing  the  Visicorder  records  for  the  step  track- 
ing task  the  following  four  terms  are  used:   step  number, 
step  position,  step  time,  end  dwell  time.   A  step  number 
with  value  N  implies  that  this  is  the  Ul      step  on  the  record. 
The  step  a-b  on  the  record  in  Figure  2  is  step  number  5  be- 
cause  it  is  the  5*"   step  on  the  record.   Step  position  refers 
to  the  position  of  a  step.   The  step  position  of  step  a-b  is 
-2.15  units  on  the  position  axis.   In  many  cases  the  step 
pos;.^ion  is  giver,  in  terms  of  the  input  voltage  to  the  oscillo- 
scope and  is  called  the  step  voltage.   The  step  voltage  for 
step  a-b  is  -5  volts.   Step  time  is  defined  as  the  time  at 
which  the  target  signal  changes  from  one  step  position  to  the 
next  step  position.   The  step  time  for  step  number  5  is  the 
time  measured  at  point  a  which  is  4.2  seconds.   The  dwell  time 
of  a  step  is  the  time  the  step  voltage  remains  constant.   The 
dwell  time  for  step  a-b  is  1  second.   The  dwell  time  for  the 
different  steps  is  not  necessarily  constant  as  shown  in  Figure 
2  and  can  vary  within  a  trial  depending  on  how  the  Motor  Skills 
system  is  programed. 

When  a  record  is  scored  one  of  the  indices  obtained  is 

overshoot-undershoot.   This  index  is  obtained  for  each  step. 

Overshoot-undershoot  is  measured  at  the  time,  t  ,  of  the  first 

o 

point  of  inflection  in  the  cursor  signal  after  a  change  in 

step  position  occurs-.   The  absolute  value  of  this  index  is 

s(t  )  -  c(t  )i.   The  si^n  of  this  index  is  negative  for  an 
o        o 

•...  [ershoi  _  and  positive  for  an  overshoot.   The  overshoot- 
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undershoot  for  step  number  2  In  Figure  2  is  measured  at  point 
c  and  has  a  value  of  H-.5,  r.nd  for  step  number  3  overshoot- 
undershoot  is  measured  at  point  d  and  has  a  value  of  -1. 

Another  inc'ax  which  is  measured  for  each  step  is  lead- 
lag.   Lead-lag  is  measured  at  the  point  where  the  cursor 
signal  breaks  away  from  the  previous  step  position  and  heads 
for  the  next  step  position.   The  absolute  value  of  this  index 
is  the  time  between  the  break  away  point  and  the  step  time. 
The  sign  of  this  index  is  negative  for  a  lag  and  positive  for 
a  lead.   The  lead-lag  for  step  number  1  in  Figure  2  is 
measured  at  point  e  and  has  a  value  of  +.1  seconds. 

No  criteria  for  scoring  the  ramp  tracking  task  are  given 
in  this  thesis  because  no  criteria  are  available  at  this  time. 
A  preliminary  study  using  the  ramp  tracking  task  is  presently 
being  conducted  by  the  Psychology  Department,  but  no  informa- 
tion on  a  scoring  procedure  is  available  at  this  time.   There- 
fore, only  the  step  tracking  task  will  be  discussed  in  this 
thesis. 
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CHAPTER  IV 

COMPUTERIZED  SCORING 

The  hand  scoring  procedure  diccussed  in  the  previous 
section  iakes  considerable  time  and  effort  to  perform.   For 
this  reason  a  computer  program  was  written  to  score  the  data 
obtainec  from  the  Motor  Skills  system.   The  indices  defined 
for  the  hand  scoring  prrcedure  could  not  be  used  in  a 
conr.uter  program  because  rhey  ware  too  general.   Therefore, 
to  obtain  a  computerized  scoring  procedure  the  indices  had  to 
be  redefined*   Some  indices  that  were  not  obtained  before 
were  also  defined  and  obtained  by  the  computer  program.   This 
section  describes  the  indices  obtained  by  the  computer,  the 
data  preparation  programs,  and  the  seeing  program. 
A,   DESCRIPTION  OF  INDICES 

To  help  describe  the  indices  obtained  by  the  computer  the 
Visicorder  record  shown  in  Figure  2  is  again  reproduced  in 
Figure  3.   Also  the  following  definitions  are  needed  to 
describe  the  indices.   Step  number  (SN)  ,  step  position  (SP)  , 
step  time  CST) ,  and  dwell  time  (DT)  were  defined  in  the 
previous  section.   Error  (E)  will  always  refer  to  js(t)-c(t)|. 
Dwell  level  (DLEVEL)  and  tee  error  levels  (ELEVEL)  are 
imaginary  levels  placed  around  the  target.   Examples  of  ELEVEL 
1  are  3hown  on  Figure  3  with  dotted  lines.   These  levals  are 
placed  around  the  target   ^gnal  so  the  relative  position  of 

cursor  signal  can  be  located.   If  the  cursor  signal  is  in 
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ELEVEL  1,  this  means  that  |s(t)-c(t)|  <_  ELEVEL  1.   An 
inspection  of  suep  nutbcr  2  on  Figure  3  shows  that  the  cursor 
signal  is  in  ELEVEL  1  between  points  C  and  A  for  this  step. 
In  the  computerized  scoring  program  five  ELEVELs  and  one 
DLEVEL  are  used*   These  1  svels  arc  all  defined  the  same  as 
ELEVEL  1,  but  they  may  have  different  values  depending  on  how 
clj-e  to  the  target  the  relative  position  of  the  cursor  is 
required. 

The  next  term  used  in  the  computerized  scoring  program 
is  time  leave  (TL)  which  is  used  to  describe  the  time  at  which 
the  cursor  signal  leaves  ELEVEL  I  of  the  previous  step  in  the 
direction  of  the  step  being  considered.   If  the  subject  does 
not  follow  the  target  well  enough  to  either  reach  or  pass 
through  ::_:.  .1  1  of  a  step,  the  time  leave  of  this  step  can- 
not be  obtained.   An  example  of  the  points  at  which  time 
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leave  is  measure  :  .  £  jown  on  Figure  3.   Points  A  and  B  are 
the  points  at  which  time  Bured  for  step  numbers 

3  and  4  respectively. 

Another  term  used  is  ti..e  arrive  (TA)  which  is  the  time 
t  which  the  cursor  signal  reaches  a  new  step  position.   This 
time  is  defined  as  the  time  at  which  the  cursor  signal  enters 

LEVEL  1  of  the  step  being  considered  from  the  previous  step 
position,,   Again,  if  the  cursor  signal  does  not  enter  ELEVEL 
1  for  a  given  step,  this  time  cannot  be  obtained.   Time 
arrive  for  step  numbers  2  and  3  on  Figure  3  are  measured  at 
points  C  and  D.   With  these  terms  defined  the  indices  obtained 
by  the  hand  scoring  program  can  be  defined. 

The  average  error  (AERR)  and  the  RMS  error  (RMSE)  are 
two  indices  which  are  obtained  for  a  whole  trial.   The  scoring 
program  calculates  this  average  error  by  summing  the  absolute 
values  of  the  error  at  each  sample  point  in  a  trial  and 
dividing  this  summation  by  the  total  number  of  points  sampled 
in  the  trial.   The  RMS  error  is  the  square  root  of  the  total 
squared  error  divided  by  the  time  of  the  trial.   The  RMS  error 
is  obtained  by  squaring  the  error  at  each  sample  point  and 
summing  these  values  over  the  trial.   This  summation  is 
divided  by  the  number  of  sample  points  in  the  trial,  and  the 
square  root  is  taken  of  the  result. 

Another  set  of  performance  indices  is  obtained  by  taking 
the  abso  ut     .ues  of  the  error  for  each  sample  point  and 
clast __      them  into  different  groups  according  to  their 
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value.   These  indices  are  referred  to  as  the  percent  of  time 
the  error  is  in  interval  (PTEI)  one,  two... six.   The  intervals 
and  the  values  of  the  error  in  ihese  intervals  are 
PTEI  1    E  <_  ELEVEL  1 
PTEI  2    ELEVEL  1  <  E  <_  ELEVEL  2 
PTEI  3    ELEVEL  2  <  E  <  ELEVEL  3 


PTEI  6    ELEVEL  5  <  E. 

The  lead-lag  CLL)  Index  is  obtained  by  the  scoring  pro- 
gram, but  the  definition  used  by  the  scoring  program  is 
different  from  the  hand  scoring  method.   The  computerized 
scoring  program  defines  lead-lag  as  the  step  time  minus  the 
leave  time.   With  thij  definition  LL  is  positive  for  a  lead 
and  negative  for  a  lag. 

To  indicate  the  time  required  for  a  tracker  to  move  from 
one  step  position  to  the  next  the  computerized  scoring  progr 
measures  the  time  of  response  (TR)  .   Time  of  response  is  de- 
fined as  time  arrive  minus  time  leave  divided  by  the  absolute 
value  of  the  target  change.   The  value  of  the  target  change 
is  the  step  position  of  the  step  being  considered  minus  the 
step  position  of  the  previous  step.   On  Figure  3  the  time 
of  response  for  step  number  three  is  the  slope  of  a  straight 
line  connecting  points  A  and  D. 

To  give  an  indication  of  how  well  the  tracker  follows 
the  target  for  each  step  an  index  of  performance  referred  to 


am 
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as  time  on  target- (TT)  is  obtained.   Time  on  target  is  defined 
as  the  lime  during  a  step  that  the  error  is  less  than  the 
DLEVEL  divided  by  the  dwell  time  ox    the  step.   The  computerized 
scoring  program  courts  the  n   x  r  of  sample  points  which  satis- 
fy the  condition  that  E  <  DLEVEL  during  a  step  and  then  divides 
this  number  by  the  dwell  time  of  the  step. 

The  last  index  obtained  by  the  computer  is  overshoot- 
undershoot  (OU)  .   This  index  is  defined  as  the  first  point  of 
inflection  in  the  cursor  signal  after  the  cursor  signal  obtains 
a  value  equal  to  one-half  the  distance  between  the  step  posi- 
tion for  which  the  OU  is  measured  and  the  previous  step  posi- 
tion.  For  step  number  1  on  Figure  3  the  OU  is  measured  at 
the  first  point  of  inflection  after  point  I.   The  point  of 
inflection  occurs  at  point  J.   .'he  absolute  value  of  OU  is 
equal  to  the  error  at  the  point  of  inflection.   The  sign  of 
the  OU  index  is  negative  for  an  undershoot  and  positive  for 
an  overshoot*   The  time  that  OU  occurs  (TOU)  is  also  obtained. 
3.   DATA  PREPARATION  PROGRAMS 

The  sample  points  obtained  from  the  A-D  converter  were 
read  into  the  IBM  360  computer  from  the  digital  tape  recorder. 
The  sample  points  for  each  trial  were  placed  into  two  arrays. 
These  arrays  were  the  target  array  (TG)  which  contained  the 
sample  points  of  the  target  signal  and  the  cursor  array  (CR) 
which  contained  the  sample  points  of  the  cursor  signal.   There 
were  IOC      pie  points  obtained  for  each  trial  so  there  are 

poj   .  l  .  TG  and  C2.a       The  value  of  every  sample  point 


was  multiplied  by  a  constant  go  the  different  values  corres- 
ponded to  the  step  positions  displayed  on  Visicorder  records 
and  not  the  step  voltages  reoorcjj  by  the  tape  recorder.   This 
was  performed  so  the  values  measured  by  the  computerized 
scoring  program  would  correspond  to  the  values  measured  by  the 
hand  sec  ring  method. 

An  inspection  of  the  target  and  cursor  arrays  for  differ- 
ent trials  showed  that  there  were  noise  points  in  the  data 
that  Gid  not  correspond  to  the  target  and  cursor  signals 
at  the  time  the  sample  occurred.   The  noise  observed  consisted 
of  low  level  noise  and  high  leval  noise.   The  causi  of  the 
high  level  noise  was  discussed  in  Chapter  2  of  this  thesis. 
The  source  of  the  low  level  noise  was  not  traced,  but  a  good 
source  for  this  noise  would  be  the  analog  and  digital  record- 
ing equipment.   To  remove  these  noise  points  two  programs 
were  written.   One  program  removed  the  noise  points  from  the 
target  array,  and  the  other  program  removed  the  noise  points 
from  the  cursor  array. 

The  program  to  remove  the  noise  points  from  the  target 
array  is  SUBROUTINE  TANOST(TG,NPTS , ZERO, ONE , TWO, THREE , FOUR, 
FIVE, SIX, SEVEN).   The  name  TANOST  was  derived  from  TArget- 
NOise-STep,   The  target-noise  designated  that  this  subroutine 
removes  the  noise  from  the  target,  and  the  step  implies  that 
this  subroutine  ic  for  the  step  trucking  task  only.   The 

.a  are,  TG  wl  .  h  ic  the  :  ar 
ay;  NPTS  which  is  the  i    .mber  of  points  in  the  array;  ZERO, 
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ONE,  ,     .  .  SEVEN  which  are  the  absolute  values  of  the  differ- 
ent step  voltages  that  can  be  programed  into  the  Kocor 
Skills  system.   The  last  seven  arguments  have  a  value  of  1 
or  0.   The  value  is  1  if  the  step  voltage  was  used  and  0  if 
the  step  voltage  was  not  used.   This  tells  the  subroutine 
which  values  the  target  array  car.  have. 

i  subroutine  TANOST  is  called  it  takes  every  point  N 
in  array  TG  and  sets  TG(K)  equal  to  the  nearest  step  position. 
This  removes  all  of  the  low  level  noise  points.   Then  the 
subroutine  goes  back  through  the  array  and  changes  the  remain- 
ing noite  points  cuch  that  each  point  in  the  array  satisfies 
one  of  the  following  conditions: 

1,   TG(N)-TGCN-l) 

2S   TGCN-l)^TG(N)«TG(N+l)=TG(N+2)  . 

The  first  condition  assumes  thai  N  is  a  point  on  a  constant 
step  position,  and  she  second  condition  assumes  that  N  is  the 
first  point  on  the  next  step  position. 

The  noise  in  the  cursor  array  is  removed  by  SUBROUTINE 
CUNO(CRtNPTS,MR) .   The  name  CUNO  is  derived  from  CUrsor-NOise. 
This  program  is  not  limited  to  the  step  tracking  task.   The 
arguments  of  this  subroutine  are  CR  which  is  the  cursor  array, 
NPTS  which  is  the  number  of  points  in  the  array,  and  MR  which 
is  the  assumed  maximum  response  of  the  human  being.   MR  is  the 

:iraum  change  the  cursor  signal  can  make  in  50  milliseconds. 
After  comparing  several  cursor  si  ^nals  displayed  on  a  Visi- 
corder  reccrc  with  a  plot  or  r h ..  cursor  arrays  MR  was  ret 
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at  .2.   This  program  checks  every  point  N  in  the  cursor  array 
until  a  jign  change  occurs  in  the  equation  (CR(N)+10)- 
(CR(N+1}+10) .   This  equac.      .;kj  for  the  points  at  which 
the  cursor  signal  changes  directic ..«,   If  a  noise  point  exists 
in  the  cursor  array >  a  plot  cf  the  cursor  signal  described 
by  the  cursor  array  must  either  change  directions  to  reach 
the  noise  point  or  it  must  change  directions  to  return  from 
a  noise  point*   If  a  noise  point  exists  without  causing  the 
cursor  signal  to  change  directions ,  the  noise  point  was 
assumed  negligible.   Ten  is  added  to  CR(N)  and  CR(.J-rl)  to 
remove  the  bipolar  property  of  the  cursor  signal  so  that  a 
sign  change  in  the  equation  is  created  by  the  relative  posi- 
tion of  CR(N)  and  CR(N-:-l)  and  not  the  original  sign  of  CR(N) 
or  CR(N+I) .   When  a  sign  change  occurs,  the  equation  AV= 
(CR(N-1)+CR(N+1))*.5  is  compared  with  CR(N) .   If  AV-CR(N) >MR  , 
then  CR(N)  Is  set  equal  to  AV.   If  AV-CR(N) <MR,  CR(N)  is  not 
changed* 

A  listing  of  SUBROUTINE  TANOST  and  SUBROUTINE  CUNO  is 
presented  in  Appendices  A  and  B  respectively  (All  programs 
listed  in  the  Appendices  were  written  in  Fortran  IV 
language  .  )  . 
Co   SCORING  PROGRAM 

The  program  which  was  used  to  score  the  data  from  the 
Motor  Skills  system  is  SUBROUTINE  SCORE.   A  flow  diagram  of 
subroutine  SCORE  (SCORE)  .    iven  in  Appendix  C  and  a  listing 
is  prec-nted  in  Ap]  ;ndix  D„   In  discussing  this  program 
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references  will  be  mace  '- o    the  flow  diagram  and  listing  by 
(23-27)  .   When  this  occurs,  it  will  ....an  that  the  operation(s) 
just  described  is  performed  by  statement  number(s)  23  to  27. 
The  designation  of  the  different  variables  used  in  this  pro- 
gram are  the  same  as  the  abbreviations  of  the  terms  defined 
in  part  A  of  this  section.   The  arguments  for  subroutine 
SCORE  ere: 

Input 

TG; . . . « • .  .Target  array 

CR« ««..... Cursor  array 

ELEVEL. •  • .Array  containing  the  values  of  the  five  error 
levels 

DLEVEL. .. .Value  of  the  time  on  target  level 

NPT3. «... .Number  of  points  in  the  target  and  cursor 
arrays 

LIST ..... .Printing  instruction 

Value  of  one  ■  ?rint  indices 

Value  of  Zero  =  Do  not  print  indices 

Output 

NSTEP.. •« .Number  of  steps  scored  and  the  number  of  values 
in  the  following  arrays 

ST. . « . . « • « Step  time  array 

TLo . . . . c • .Time  leave  array 

TA. ••«•«• .Time  arrive  array 

TT.  .  •  «  .  i.  ,  cTime  on  target  array 

LLiuiJ)J.      -     irray 

TR« ...... .Tire  of  response  array 
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SP.  ......  .Step  pos:'.  tion  array 

0U« .«•«.« (Overshoot-un     I  oct  array 
TOU,  ,  j  t<<l  jTiini  of  OU  array. 

The  arrays  contained  in  the  arguments  as  output  are  all 
of  the  indices  scored  for  each  step  so  they  have  a  value  for 
each  step*   The  following  is  a  'description  of  how  SCORE  obtains 
these  indices. 

When  the  target  and  cursor  signals  were  sampled,  the 
sampling  rate  was  20  times  per  second  or  50  milliseconds  be- 
tween samples.   To  obtain  more  accurate  results  SCORE  generates 
a  mid-pcint  between  every  two  points  of  the  TG  and  CR  arrays 
(16-19).   The  new  arrays  are  called  the  S  array  for  target 
array  and  C  array  for  the  cursor  array.   The  time  between 
points  for  the  S  and  C  arrays  is  25  milliseconds.   The  number 
of  points  in  these  arrays  is  NP=2(NPTS).   After  generating  the 
mid-points  SCORE  sets  all  the  values  in  the  TL  and  TA  arrays 
zo    zero  C20-25) .   This  is  done  so  the  presence  of  new  values 
can  be  detected  later  in  'the  program. 

All  the  operations  (30-350)  in  the  next  part  of  SCORE  are 
performed  on  every  point  in  the  S  and  C  arrays.   SCORE  uses 
N  to  define  which  one  of  the  points  in  S  and  C  to  operate  on, 
and  M  is  used  to  keep  track  of  which  step  is  being  scored. 

The  first  thing  SCORE  checks  for  is  a  change  in  step 
position  (101).   At  this  point  SCORE  goes  to  one  of  two 
different  parts  c  i  th   -  -o<  ram   .  .     ng  on  whether  or  not  a 
step  cha,  ge  c  xurred,   If  a  step  change  does  occur,  SCORE 
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tries   ..  .".  ..d  the  indices  that  have  not  been  score-''  for  that 
step  and  records  these  iudi  e   if  they  are  obtained.   There- 
fore, before  the  operatic  5  ■   ;rfor     by  SCORS  at  a  step  change 
(102  or  I04-62C)  can  be  di^  zusssd,  an  examination  of  the  oper- 
ation, performed  when  a  step  change  does  not  cccur  (700-850)  is 
needed < 

SCO...       ^ach  point  through  this  part  of  the  program 
even  if  a  change  in  step  position  is  detected.   The  absolute 
value  of  the  error  (E)  is  calculated  first  (700).   Then  SCORE 
checks  to  see  if  E  is  less  than  or  greater  than  ELEVEL  1  (706). 
(In  the  >rogr  .  -.  ELEVEL  1  is  changed  to  ELI  and  ELEVEL  (K)  is 
changed  to  SL(K) (14-16) .)   If  E  is  less  than  ELEVEL  1,  the 
cursor  signal  is  in  ELEVEL  1;  and  if  E  is  greater  uhan  ELEVEL 
i„  the  cursor  signal  is  out  of  ELEVEL  1.   At  this  joint  SCORE 
needs  to  know  whether  or  not  the  error  signal  was  in  or  out 
of  ELEVEL  1  for  the  previous  sample  point  so  the  location  of 
time  leave  or  time  arrive  can  be  located.   SCORE  uses  the 
variable  10  to  keep  track  of  this.   10  is  set  for  each  point 
in  the  S  and  C  arrays  and  has  a  value  of  -5-  1  (715)  if  the 
cursor  is  in  ELEVEL  1  and  -  1  (721)  if  the  cursor  signal  is 
cut  of  ELEVEL  L   Therefore;,  the  next  operation  performed  by 
SCORE  is  to  check  10  (702  or  71.)  to  see  if  the  cursor  was 
in  or  c_   cf  ELEVEL  1  for  the  previous  sample  point.   If  the 
c  rsor     ial  ..   out  of  ELEVEL  _   for  th^s  sample  point  and 
if  i-  -  ■   in   .  _ViL  1  for  the  previous  sample  point 9  SCORE 
records  the  time  of  this  sample  as  tir.e  leave  for  the  next 
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)  (720).  SCORE  hecks  th±c  for  every  sample  point  so  if 
the  cursor  leaves  ELEVEL  1  for  given  3tep  core  than  once, 
the  vai  a  for  -  is  finally  recorded  is  the 

last  tiv.:.  that  this  cc  .  ,r  i  step.   If  the  cursor  signal 

is  in  EL2VEL  1  for  this  sample  point  and  if  it  was  out  of 
ELEVEL  1  for  the  previous  sample  point,  SCORE  checks  to  see 
if  a  value  for  time  arrive  had  been  recorded  previously  (712). 
If  a  value  had  not  been  recorded;,  SCORE  records  the  time  of 
this  sample  cj  time  arrive.   If  there  is  no  change  in  the 
relative  position  of  the  cursor  and  ELEVEL  1  for  the  two 
sample  points,  nothing  _s  reccrdjc. 

After  checking  for  a  time  leave  or  a  time  arrive  SCORE 
locates  which  error  interval  E  is  in  (740-750)  and  adds  one 

to  the  proper  interval  (800).   E  is  added  to  the  total  error 

2 
C802) ,  and  E   is  added  to  the  total  squared  error  (804).   E 

is  checked  to  see  If  it  is  less  than  the  DLEVEL  (315);  if  it 

is,  the  number  of  points  for  which  E  is  less  than  the  DLEVEL 

for  this  step  is  increased  by  one  (815).   SCORE  then  returns 

to  check  another  point. 

operations  performed  by  SCORE  at  a  step  change  are 

as  follows.   The  direction  of  the  step  change  is  recorded 

(102  or  104),   The  variable  M  which  keeps  track  of  the  step 

number  being  scored  is  advanced  by  one  (106),  and  the  time 

that  th:*-j  sample  occurred  is  recorded  as  the  step  time  (107). 

The  time  on  target  for  the  previous  step  is  calculated  by 

div:      the  nt   sr  of  points  during  the  step  for  which 
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E  _<  DLEVEL  by  the  uotal  number  of  points  which  occurred 
during      -  tep  (108).   The  variable  which  counts  the  number 
of  points  during  a  ii_v  for  which  w  <  JLEVEL  is  then  set  back 
to  zero  ( 109) * 

The  next  thing  SCORE  must  cheek  is  whether  or  not  the 
proper  value  cf  time  leave  has  been  recorded  and  whether  or 
not  the  proper  value  of  tine  arrive  will  be  recorded.   To 
check  this  SCORE  must  find  the  location  of  the  cursor  signal 
at  this  sample  point  (C(K))  and  compare  this  location  with 
the  targe;  . osition  (S^N-l))  of  the  previous  step  and  the  tar- 
get i,osi.:ion  of  the  next  step  (S(N))«   To  illustrate  this, 
assume  that  SCORE  has  found  the  step  change  between  step 

_■  3  and  step  number  6  on  Figure  3.   The  step  change 
would  have  been  detected  at  the  K"n  cample  point  so  S(N)  is 
equal  to  step  position  3  and  S(N-l)  is  equal  to  step  position 
5o   CCN)  must  be  between  the  bottom  end  of  range  W  and  the 
top  end  of  range  P.   The  first  place  SCORE  checks  for  C(N)  is 
in  ELEVEL  1  of  -tep  number  3B   If  C(N)  is  in  ELEVEL  1,  SCORE 
advances  N unti_  the  point  az   which  the  cursor  signal  leaves 
ELEVEL  1  is  found;  and  this  value  of  N  is  recorded  as  time 
leave  (202-206) *   If  C(N)  is  not  in  ELEVEL  1  of  the  previous 
step,  SCORE  checks  whether  C(N)  is  above  or  below  ELEVEL  1 
of  the  previous  step  (300).   SCORE  compares  this  with  the 
direction  of  t^e    target  change  to  see  if  aha  cursor  signal 
is  ir.  the  proper  direction  (302  cr  304).   On  Figure  3  the 
--"  direction  is  :  proper  direction  is 
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in  rangiJ  Q,  ELEVEL  1  for  Si:  6,  and  P,   If  the  cursor  signal 
is  in  the  improper  direction,  SCORE  aclv  r.ccc  N  until  the 
cursor  signal  reache:  a  value  greater  than  or  equal  to  the 
step  position  of  the  previous  step  and  records  thi£  value  of 
N  as  time  leave  (400-420).   If  the  cursor  signal  was  in  the 
proper  cirection,  ar.  assumption  is  made  that  time  leave  had 
been  obtained  when  it  left  ELEVEL  1  during  the  previous  step. 
On  Figure  3  C(N)  would  designate  point  Y  which  is  in  the 
proper   Lrection.   If  a  value  of  time  leave  was  recorded, 
SCORE  continues  to  that  section  of  the  program  described  first; 
but  if  the  cursor  signal  is  in  the  proper  direction,  SCORE 
chac'.cs  to  see  if  the  cursor  is  in  Q,  P  or  ELEVEL  1  of  the  step 
being  scored.   SCORE  checks  ELEVEL  1  (500)  first,  and  if  the 
cursor  signal  is  in  ELEVEL  1,  SCORE  decreases  N  until  the 
point  at  which  the  cursor  signal  enters  ELEVEL  1  is  found. 
This  value  of  N  is  recorded  as  time  arrive  (502-5GU) .   If  C(N) 
is  r.ot  in  ELEVEL  1,  SCORE  checks  to  see  if  it  is  above  or  be- 
low ELEVEL  1  (600).   Then  SCORE  compares  this  with  the  direc- 
tion of  the  target  change  to  see  if  C(N)  is  in  the  proper 
direction  (601-608).   For  this  case  the  proper  direction  en 
/are  3  is  range  Q ,  and  the  improper  direction  is  range  P. 
If  C(N)  is  in  the  improper  direction,-  SCORE  decreases  N  until 
the  cursor  signal  is  kss  than  or  equal  to  the  step  position 
and  reco-ds  this  value  of  M  as  time  arriva  (601-52C).   If 
is  in  tie  proper  direction  (range  Q  or.  Figure  3),  an 
assumptd  m  is  .  _ic  that  time  leave  will  ba  raccrdei  whan  the 
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cursor  signal  reaches  SLEVEL  1  of  the  step.   Then  SCORE  con- 
tue3  to  that  part  of  the  program  .  .ich  was  described  first. 

After  SCORE  perforins  :ri! aperations ,  the 

number  cl  steps  scored  is  recorded  'J  The  i      i   ;e  error 

(352   a    the  RMS  error  (854)  era  Jbtained,  and  the  six  PTEI 
score:      converted  to  percent  (355).   All  of  the  values  of 
time  which  were  recorded  are  converted  back  so  they  corres- 
pond to  the  original  sampling  rate  (857-355).   Lead-lag  (lead- 
lag  is  c    j   ZL  in  the  prograa)  (867)  and  time  of  response 
(86  8)  are  obt     sd ,  for;  the  steps  where  the  time  leave  and 
time  arrive  were  scored.   If  TL  or  TA  were  not  scored  for  a 
step,  lead-lag  (853)  and  time  of  response  (864)  are  set  equal 
to  77...  7  ^o  designate  that  the  value  could  not  be  obtained. 
Then  SCORE  finds  the  mid-point  for  each  step  change  (859-372) ' 
and  locates  the  sample  point  C(N)  where  the  cursor  signal  is 
equal  to  this  mid-point  (874-894).   On  Figure  3  this  point  for 
step  number  one  is  point  I.   After  this  point  is  located, 
SCORE  increases  N  until  the  point  at  which  the  cursor  signal 
changes  directions  is  located  (896-908).   On  Figure  3  this 
point  is  point  J.   The  difference  between  the  cursor  signal 
and  targ  .     nal  at  this  point  is  recorded  as  OU  (910),  and 
the  value  N  for  this  point  is  recorded  as  TGU  (912, .   Then 
SCORE  checks  to  sea  if  a  listing -was  requested  and  either 

— '-  •  -  -"'•  -  information  c.  tained  or   er:  inates  (950- 
lOOO). 


(   .?TSR  V 

MATHEMATICAL  ANALYSIS 

The  computerized  scoring         ,  (SCORE),  described  in  the 
previous  section  obtains  many  useful  indices  on  each  step  change, 
To  obtain  i:      .tion  about  a  whole  trial,  averages  of  the  in- 
dices must  be  taken.   Also,  before  SCORE  can  obtain  lead-lag  and 
time  of  response  for  a  step,  the  subject  must  pass  through 
ELEVEL  1  which  places  a  restriction  on  the  level  of  performance 
which  can  be  scored.   Therefore,  to  obtain  general  information 
on  a  whole  trial  which  is  independent  of  the  performance  of  the 
tracker,  the  tools  of  communication  theory  were  stuoied  to  see 
if  chey  could  be  used  to  score  the  human  tracker.   To  accomplish 
this  a  mathematical  r..oael  was  assumed  for  the  human  tracker;  the 
tools  of  communication  theory  were  applied  to  this  model;  and 
the  results  were  compared  with  actual  data.   The  mathematical 
model  and  the  application  of  the  tcolb  of  communication  theory 
to  this  r.oc-1  are  discussed  in  this  section.   The  comparison  of 
the  results  with  actual  data  will  be  discussed  in  the  next 
section . 

■ 

A.   MATHEMATICAL  MODEL* 

The  n athemj  tical  model  used  to  describe  the  human  tracker 
is  shown  in  Figure  4, 


-   thesi       not  designed  to  obtain    m  t      ical 

model  fo:    te  :        .  ii.  .   Th  .  aodel  was  used  only  as  a  tool 

:o  obtaii   ...  cor:_  »  mathc  . .   The  des^ri^^icn  of  the  human  being 
.-  the  psychologist. 
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s(t) 


s'(t) 


Second  Order 

Sys;em 


■*•  c(t) 


Figure  4.   Mathematie  .1  Model 

This  model  wes  assumed  after  inspecting  several  Visicorder 
records  of  the  target  and  cursor  signals.   The  records  showed 
that  the  response  of  the  trackers  to  the  step  tracking  task 
could  be  approximated  by  an  under damped  or  overdamped  second 
order  system.   In  some  cases  the  trackers  anticipated  the  time 
at  which  the  step  change  would  occur  and  lead  the  s ;ep  change, 
and  in  other  instances  the  subjects  would  lag  the  step  change. 
The  time  shift  a.  was  included  in  the  mathematical  modal  to 

c be a in  a  lead  or  a  _~_,  in  the  response.   The  subic.'-v;  -  is 

fch 
used  to  describe  the  i    step  in  the  step  tracking  task  so  a. 

can  have  a  different  positive  or  negative  value  for  each  step. 

No  records  were  available  for  the  ramp  tracking  task  so  only 

the  step  tracking  task  will  be  used  in  this  analysis. 

The  input  signal  or  target  signal  s (t)  can  be  described  by 


3(t)      - 


Z    V.U(t-T. ) 
i=0   i  x 


(4) 


where    V. 
x 


_ 
n     - 

-    - 


th 

vaue    of    the    step    change    for    the    i         step 

tine    the    step    change    occurs    for    the    i         step 

iber    of    step    changes    in    a    trial 
tin    . 
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unit  step  function  U(  -T  value  of  0  for  -«><t<T. 

a  value  of  1  for  T.<^t<°°.   The  Motor  Skills  syst-m  is  pro- 
gramed z     ;h  ,      .  ;.  — gei  .  . .  ..   .   :arts  at  «cro  a::d  ends  at 

zero.   Therefore,  V   -  C  .  id  11      =  C. 

The  dwell  time  for  the  ±til    seep  is  defined  as  d  ■  T .  , ,  -  T .  . 
In  this  analysis  the  dwell  time  for  each  step  (d)  is  assumed 
constant  because  all  of  the  data  available  at  this  time  has  con- 
stant dwell  times.   If  the  dwell  time  is  not  constant,  then  d 
must  be  the  minimum  dwell  time  in  the  trial  for  thia  analysis 
to  be  valid.   The  records  of  the  target  and  cursor  signals  showed 
that  the  time  shift  a.     could  be  restricted  to  -d/4<a.  <d/4  except 
for  the  very  poor  trackers.   With  this  assumption  the  signal 
after  the  time  shift  can  be  described  by 


s' (t)  =   I  V.U(t-T .-a. ) 
i=0  x  "   i 


(5) 


.-"_-  ere   -d/4<a.<d/4 


The  second  order  system  has  a  transfer  function  in  the 
complex  frequency  domain  of 


H(s) 


s  +  2  o  oi  s + u 

n     n 


(6) 


are      s         Laplace       raiisform    cpa_;.^r 
o    -       ar.pii       ratio 

-  .    -       :  u  :  _  q  i  _ ...  cy  . 
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Equation  6  is  ,.        most  control  systc  m  books  to  describe  a 
general  ..eeond  orde.-  systar...   For  a  specific  example  see  Kuo 

2,  p   126-129).   A  better  approxi  i   on  ^o  the  actual  data 
would  be  equatior.  6  multiplied  by  -  :    tant  K,  but  this  adds 
to  the  c        _\  o   :he  analysis  without  a  sufficient  increase 
in  information  obtained  from  the  aiaiysis. 

The  impulse  response  h(t)  for  the  second  order  system  can 
be  obtained  by  taking  the  inverse  Laplace  transform  of  equation 
6.   This  can  be  found  in  tables  of  Laplace  transforms  as 


-OoJ  t 


h;t;    =  -      e"0lUnL    sinw    /7~    .2    t      .  (7) 

/7~2  n    1  "  6 


1     s    output    signal    c(t)    can    be    obtained    by    the    convolution    in- 
tegral   (Hancock,    1961).       Then 

c  [t)    =    /   h(t)s'  (t-x)dt  (8) 

0 

where  s'Ct-x)  can  be  obtained  from  equation  5.   The  summation 
in  equation  5  can  be  interchanged  with  the  integral  which  gives 


(t)  =  Z    V.  /  h(x)U(t-T.-o.-T)dt    .  (9) 

i»0  1   0  x   x 


Assume  that  h(t)  has  a  different  set  of  parameters  for  each 
step  am      5.  =  6  and  u> .  =  j_  in  -quation  7.   Then  equation  7 
ca;.  be  r< 
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h.  (..:}    = -  —   a""°ia)i"    sinu,/,     .    2         t  .  (10) 

/ ~-  i    1-5  . 

Vs.2 

x 


If   h(x)    la    ob:.  from   eq  iati  .0 ,     .h .     evaluation    of    equation 

9    becomes 


c(t)    -       E    V,  fl-    ±—   e-3iLJi(t-Tj-ai)     X 

1-0    ^l-        ■/.      .    2 

_-<5  . 
i 


!in[«1/1_fi    2     (t-TjL-o1)+8i]jU(t-T1-o1) 


u  r>  "I  1-0  -f 

wnere    3      =    can         : — - 

6i 


Let 


l-o  . 


iia[»i/1_6    2    (t_T  )+g 

x  _       _         1 


thv.:. 


(ID 


(t)    -       E    V.[l-R    (t-T    -ct.)]U(t-T    -a.)       .  (12) 

_=c  -  x     - 


-£    5    shows    some    a    rm  :id    plots    of    c(t)    vsrsus    u . t 

°)     f-r    -  /slues    cf    o.       In    refari-ir.g  i:he    damping 

rati  -     •  —    -  sr    sy^;em    ';hree  used.       These 
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Figure  5.   Plots  of  c(t)  for  different  S's. 
terms  alci;g  with  the  range  of  6  are: 
underdamped  system      0<8<1 

critical  damped  system   5-1 

ovei damped  system        6  >  1  . 
Figure  5  j'.iows  the  type  of  response  obtained  for  each  of  these 
cases . 

th  s(t)  described  by  equation  4  and  c(t)  described  by 
equation  12  the  error  signal  e(t)  is 

e(t)  =  s(t)  -  c(t) 


-   Z  V  [U(t-T. )  -  U(t-T.-a, ) J 

i=0  1         X  11 


(13) 


i 


R  [t-T 

>c  x  - 


-a,  )U  ;t-::  ,  -a.  ) 
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Therefore,  s(t)  describes  the  target  signal,  c(t)  describes  the 

cursor  signal  and  e(t)  describes  the  error  signal. 

B.   APPLICATION  OF  THE  TOOLS  OF  I      LIGATION  THE 

The  correlation  functions  (auto  correlation  ar.d  cross 

correlation)  were  applied  to  s(t),  c(t)  and  e(t).   In  describing 

:crraiation  functions  9(x)  will  be  used  to  designate  the 

correlation  function,  and  the  subscripts  on  d(x)  will  designate 

which  sijnals  were  correlated.   Then  d   (x)  is  the  auto  corre- 

ss 

lation  of  the  target  signal  s(t),  and  6   (t)  is  the  cross 

s  c 

correlation  of  the  target  signal  s(t)  with  the  cursor  signal 
c(t).   After  checking  the  results  obtained  from  applying  the 
correlation  functions  to  s(t),  c(t)  and  e(t)  the  cross 
correlation  of  the  target  signal  and  the  error  signal,  6   (t) 
was  found  to  be  the  nest  sensitive  to  a  time  shift  : ;    therefore, 
.  .ation  can  be  obtained  from  d   (x)  than  the  other 

S  B 

correlati  -    :t:  om   . 

The  cross  correlation  cf  two  aperiodic  functions  f. (t)  and 
f„(t)  is,  according  to  Lee  (1J60,  p  44) 


4I12^T) 


/  f1(t)f2( 


■T)dt, 


(14) 


Substituting  f  (t)  -  s(t),  f9(t)  -  e(t)  into  equation  14,  d   (x) 

becomes 


sc 


=  /  s(t). 


(15) 
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If    e(t)    ■    s(t)    -    c(.)    is    substituted    into    equation    15,    t>       (x) 
can    also    be    expressed    £3    $       (x)    =    $       (?)     -    $       (x). 

If    equation    4    is    substitute  r    s(t)    and    equation    13    is 

subs-..;u.ad    for    e(t),    eq  _     _  i. 


.s 


r; 


se 


E         Z    V    V.    /    U(t-T,)[U(t-T    -T)-U(t-T    -a    -x)]dt 

i=0      j  =  0  J      -co  1  J  J  J 


(16) 


R  n  <» 

E    V   V      /    R,(t-TJ-a.-T)U(t-T.)U(t-T.-a.-T)dt. 
i*  0    j=0    1   J    -»   J  JJ  -  JJ 


The  limits  of  integration  or.  the  two  terras  in  equation  16  are 
controlled  by  the  unit  step  functions.  The  limits  on  a.  were 
stated  previously  as  -ci/4<a  <d/4.  If  the  time  shift  x  of  the 
cross    correlation    function    is    restricted    to    -d/2<x<d/2 ,    then 

-3/4d<t+eJ  <3/4d.       With    these    bounds    placed   on    a. ,  ,    x    and    a.+T 

-  -  '         i 

the  time,  t,  at  which  the  integrands  of  equation  16  are  zero 
ci-n  be  located.   Table  1  lists  different  ranges  of  j  and  x 
along  with  the  location  of  the  boundaries  of  the  unit  step 
functions  of  equation  16.   From  this  the  lower  and  upper  limits 
of  integration  are  listed  if  the  integrand  is  not  zero. 

If  the  limits  described  on  Table  1  are  placed  on  equation 
16  and  the  integrals  are  evaluated,  equation  16  becomes 
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i,  2 


b.  {•:  : 


c    e 


[a.(x+£     )+2B.]       ; 
i 


-d/2     ;  a(0 ,-a. ) 


(la) 


I  a  .  +  t  -■- 


.1 


Tse 


2    V       S 

k=0 


[-t+c . e 


-  ji  -<T<0 


b     (T+a    ) 

1  *    sin[ai(T+ai)+23i] 


0<t<-a , 


25  . 


[a.v   — -]  ;       cax(0,-a.)<T<d/2 


(lb) 


(lc) 


(Id) 


v        i-i 


2         E    V   V    c.e 
_=0    j=o    -    J    J 


-b . (T.-T.-a.-x) 

3133        sin[a,(T.-T   -a.-r)+26.3 

:      -     j      j  J 


a  26  . 

+      I  I      V .  V  .  [  a  .  +  -7T-2-] 

i-0    J-l+1    x   2      J      ""j 


where 


(17) 


a.    =    cj.  /I     ,    2 
1    l-o. 


bi  =  uifii 


c 


. 


i    _-. 


A3 


be  one  of  four  terms 
dependin  ;  on  ti  ^  p         id  -.:  •   One  thing  that 

should  be  noted  is  fi    a  I         -  -d/2<T<0  term  la  describes 
the  .   -  for   11  a.<C    .  G<x<d/:  term  Id  describes  the 

resul c. 

two  of  eq  ia  :i  -  17  can  be  reduced  by  assuming  that 

the  ex   ,crt  cf  t      -.  is  :ero  for  j<i-2.   Subs titutin; 

in  for  b   and  considering  the  limits  on  a.  ,  and  x  the  smallest 


value  for  b . (T 


■'  i  ,     /-.. 


i-2   i-2 


-x)  -  b,  (2d-c.  ,-t)  is  u,«,  (2d-d/4-d/2) 


-2 


=  u.5.K  ).   An  assumption  that  the  exponential  pert  of  term 

i  i 

two  is  zero  ';c:  j<i-2  implies  that  co.d  .(5d/4)  >>1  which  is  valid 
except  for  very  poor  trackers. 

The  third  term  of  equation  17  is  not  a  function  of  x  so  the 

shape  of  the  d>   (x)  versus  x  curve  is  independent  of  the  third 

s  e 


term. 


The    evaluation    of    equation    17    at     x  =    0    is 


fee    *      sin[-a.a.+2B.  ] 

i  i    i         - 


*     :o)  - 


se 


n         2    j 

Z    V. 

1=0   x 


25. 

[a      +   — -3 
1   i  to . 


a±l° 


■t>0 


da) 


(lb) 


I    V.V.     -c,     - 


-b  .     ..  ( 

i-1  - 


e  in  [a.     ,  (d-a. 


)+2ei_1] 


(13) 
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n  n  2  5 

+     X  :  .    - 


By  assumption  -d/4<a.<  .  then  if  iM<j<d/2,  T  is  in  the 
range  Biax(0,-ct  )<r<d/2.  Therefore,  equation  17  evaluated  for 
d/4<t<d/2    is 


n  2o 

6       ix)    =       E    V.     [a.    +   3 

i-0   i        x 


-b  (d-a         -~) 

+      I   V.V.    ,c.    ,e  X 


:in  [a..  _,  (d-a.  _,  -t)+2B    _,  ] 


n  2  6 


(19) 


I       V.V, [a.    + 


i=0    j=i+l  J  j 

If    -d/2<r<_-d/4,    then    -d/2<r<min (0 ,-a. ) .       Equation    17    evaluated 
for    -d/2<j<_-d/i    is 

r.         0         -.-b     (x+a.  ) 

*       (x)    -      Z    V.    c-e  x    sin[a. (x+a.)+28. 3 

se  .    „    i      i  i  i  i 


1; 


(20) 


"bi-l(d"ai-l"T) 


+       I    V.V.     -c,       e  X 

i=0    1    x    x    *    ~ 


tin  [a      ,  (d-a.    ,-tHI  !         3 
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n 
+  Z  Z   V  V  [o   +  —-f-l 

i^o  3=1+1  i  j  - 


Equati     .8,  .9  and  20  describe  6   (t3  for  t  -  0,  -d/2<T<.-d/4  and 

■  ■  ■ 

d/4<r<d/2.   These  equations  will  be  used  to  describe  the  shape 

of  the  4   (")  versus  x  curve. 

rse 

Figure  5  shows  several  plots  o.:  c(t),  s(t)  and  e(t)  with 
a..  >0  and  a.<0  for  the  underdanped  (6<1)  and  overdanped  (6>1) 
response    This  figure  wall  also  be  used  to  describe  $  e("0. 

An  inspection  of  equation  11  shows  that  c(t)  contains  a 
unit  step  term  and  a  decaying  exponential  sine  or  oscillatory 
term.   The  error  signal  e(t)  (equation  13)  contains  the  decaying 
exp  nential  sine  term,  but  a(t)  contains  a  pulse  term  with  a 
pulse  width  of  c...  instead  of  a  unit  seep  tarn.   This  pulse  is 
positive  for  a .  >0  and  negative  for  a.<0.   The  effects  of  the 
terns  des bribed  above  can  be  seen  on  Figure  6.   These  terms 
will  be  referred  to  in  the  following  discussion. 

The  seconc        >f  squations  17,  10,  19  and  20  describes 

area,  which  exists  tc  the  right  of  T. ,  under  the  oscillatory 

term  fro...  the  previous  step  multiplied  by  V.V.  .  and  summed  ovar 

i.   Cn  Figure  5  aha  oscillatory  term  from  the  previous  steps  is 

o  the  raspense  to  the  stop  shown.   This  case  will 

generally  be  true  except  fox  the  very  poor  trackers.   Therefore, 

....  the  e  fact  of  !"0  ia  negligible  com- 

a  a 

pared     :o    c    -  .    :  ta.       i'hs       i  term   of  :.     is     v  ilv.iplied    by 

2 

V . ~     ind       _..__.   .  ;r    i .      Vh       is    alw     \      >ositive  : affect 


';  5 


Figure    C. 


.  -  j     —- 


:  ..  d         -'  C 
1 


d    _  It)     for    5    >1,    <S    <1, 


4  7 


the  sign  of  the  terras  unuer  Che  summation.   If  different  re- 
sponses to  the       target  blgna!   re  considered,  the  values 
for  the  V.  's  will  be      .  -        refore,  to  use  q>       (x)  to 
score  i         ;  trackeri  the  targ  it  ;ignal  must  remain  the  3arae 
for  t-u  different  t 

:he  target  signal  remains  the  same,  the  shape  of  the 

9   (t)  versus  t  curve  is  assumed  to  be  dependent  or.  terms  la, 
s  e 

lb,  le  o ■_  Id  of  equation  17  ...cause  the  second  term  of  equation 

17  is  assumed  negligible  and  the  third  term  is  not  a  function 

of  t.   Consequently ,  th  -  following  discussion  will  pertain  only 

--  -h_  first  t«  -■-.  of  ,       (x).   In  discus  3  .'-■_.:•  s.\  ■-  first  tern  of 

equation  for  6   (x)  the  summation  will  be  neglected  for 
s  e 

now,  and  only  the  terms  under  the  summation  will  be  considered. 

- 
The  i    term  in  the  summation  describes  the  effects  created  by 

one  of  -  2  steps  in  a  trial. 

Terms  la  or  lb  of  equation  18  describe  the  area  under  the 
error  signal  which  exists  to  the  right  of  T..   If  a . <0  (term  la) 
and  fi.<i,  only  the  are.  c  ae  to  the  oscillatory  term  is  included. 
In  this  case  the  arc.  ....  y  _ither  be  positive  or  negative  de- 
pending en  a.,  and  g.  (sec  Figure  6a).   If  5.>1,  the  area  is 
_ys  positive  as  shown  on  Figure  6c.   If  a.>0,  the  area  is 

tive  as  shown  by  tern  lb  of  equation  18.   Term  la  has 
its  ma.      value  at  a.  0  and  this  .  .lue  is  26. /u  , 

.on  12  de  -       ,j  ^  (•/--■-  -.  Term 

tic    5  -   :ribe   all.  or  she  .._-,_      ■;  ....   rror  signal, 
t  she  area  to  she  le:  t  ,f  I  ..  s  6a  and  6c 
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is  included  in  term  one.   This  area  is  negative  30  equation  19 

will  always  have  a  value  less  than  equation  13.   Equation  18 

only  includes  the  posit:      -         tie   n  r  signal,  and 

equation  19  includes  both  the  po.  iti\  ;  and  negative  pulses  of 

the  error  signal. 

A   (t)  for  -d/2<t<-d/4  is  described  by  equation  20.   Term 
s  a 

one  of  equation  20  does  not  include  any  of  the  pulsas  of  the 
error  signal.   The  only  „rea  described  by  term  one  is  the  area 
und  •_•  the  oscil_-_ory  term  which  exists  to  the  right  of  T.-t. 
Therefore,  equation  20  will  always  hove  a  value  less  than  equa- 

.  :  ,i  18. 

"h 
Each  i    term  in  the  summation  describes  the  error  which 

c.;_sts  to  the  right  or  left  of  T  „  .   For  v-0  the  term  describes 

the  error  to    the  right  of  T .  .   As  t  shifts  to  the  right  (t>  ) . 

j. 

the  error  to  the  lefu  of  T.  (negative  area)  is  subtracted  from 
the  vol...  ,btair.ed  a-r  v=0;  and  as  v  shifts  to  the  left  (t<0), 
the  error  to  the  right  of  T.  is  subtracted.   Then  the  i    term 

is  multiplied  by  V    and  summed  over  i  which  gives  a  weighted 

th 
average  of  the  effect  or  each  i   .  terra. 

To  summarise  the  above  discussion  on  <}>   (t)  certain  pro- 

s  e 

perties  should  be  noted.   <•)  ^(x)  is  only  valid  for  scoring 
trackers  if  a  comparison  is  made  or.  the  same  target  signal. 
6   (r)  ha.,  a  raKimun  value  at  x-0.   The  difference  between 

Si 

0       (0)    and    6       (-;)     for    t>       .  :    a   wc  .     d    ,.ver:<;c    of    the    error 

s  a  s  e 

-.-  .  if t    of    T.,    and       :e    < Eferer.ce    for    T<0   is 

i 

a  weighted    a     -  . :  of    the   e:ro:         ..  -  .     ixists    to    the    right    of    T .  . 


w, 


Another  funct:     hich  can  be  used  to  score  the  human 
track  ex-  is  the  ensemble  eve  rage  over  all  steps  of  the  absolute 
vr.lua      le  err 

ctzion       be  referrec;  to  ...  EAE  and  designated  by  v(t). 
liquation  for  ZA i    is 


v  fror  T   1  jrmalized  by  V_,  . 


*'■■■>  -  i 


-=  0 


_ 


(21) 


A  plot  of  ii(t)  versus  t  shovs  the  normalized  average  error  that 
exists  a  distance  t  fro...  1  .   Since  this  function  is  normalized 
by  V.,  it  car.  be  used  to  check  results  obtained  from  different 
tar-ret  signals. 
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■  . . .  'I 

ULTJ  ANE  CONCLUSIONS 

he  scorin      .27  crisis  from  nine  dif- 
ferent subjec  :t  ■<-  •   -'-11  of  these  trials  had  been 
hand  scored  by  the  Psychology  Department.   The  iacaces  ob- 
tain             luas  compai  id  with  the  hand  scored  indices. 

..  _  disca on  shows  the  results  of  this  comparison. 

A.   RESULTS  OBTAIN  D  FROM  uCGSI 

ja  error      i  ied  from  SCORE  was  compared  with 
th£         ted  error  scc.-e  obtained  frou  .he  Motcr  Skills 
systems       e  two  ir.di.ca3  uere  the  same  except  for  a  constant 
scale  factor.   The  accuracy  of  the  RMS  error  could  nor  be 
checked  .     ie  it  had  not  been  obtained  previously.   One 
Chi  g     t  should  ba  noted  about  the  LK3  error  is  ;ha:  it 

Lifies  the  larger  errors  and  reduces  the  smaller  errors. 
Sine  .      larger       's  usually  occur  close  to  the  step 

tge,  the  Rl-f   ..'.r^:  obtains  meaningful  Information  ccn- 
c  .  linf  -  i  -   J  ar  i  of  the  tt   .al 

In  socs  caces  the  lead-lag  indices  which  were  obtained 
from  -  iron  the  "nana  scored  indices.   This 

c  .: _  .  ;   was  <  rca  ed  by  the  difference  in  the  definition 

of  the  iudiceso   The  h  ."ad    scorer  could  ijck  at  a  record  and 

tier,   ha  :  rr.or  si    3  beaded  for  tt  ;  new 

hv.  .'. rded  c]  i  s  cursoi 

This  dif ferer a  i   by 
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reducing    i:ho    siz<     of    K  1      h       i'     r,     :he   number    of    st 

th£       c  •-         ■    ;-    the     iccuracy    for    the    entire 


tri  ._ 


:  .  ^  jar      and  PTEI  indices 

coal   a<   be  .   ■■  lag.   These  indices  are 

the  :y?e  of  ;r.d.  .   :ored   o  they  should  be 

fairly 

is  on    o;       :1        overshoot-  jrshoot    indices    obtained 

frotl    th  gt    ode    si  d   that    SCCR:;    measured   this 

jx    fa    c  .y    con:--    tently    as    long    as    the    poinc    o,:    overshoot 
or    »  ot  re  ;.l    -    -■    -.  ■        I*    -he    subje     ;   made     a    over- 

L   stei  -    -    of   CU    measured   by 

SCORE  usually    different    fr     value    measarei     by    the 

:    if    the    r<  »po: is.  :      n am]    -  .    response, 

th«  sasured  was    the    - 

B.       RESL,V£    OBTAINED    FROM    EAE  CROSS    CORRELATION    OF 

THE    -ARGET    SIGN. 

cross  .     .  the    target    . agnal  with    the 

arror   s:  _a__         3    obtained   by    the    cross    covariance    subroutine 

Csubrout .    CROSS)    available    in    the    IBM   System/360    scientific 

subr.  ...      --    listing    of    subroutine    CROSS    is    giv< 

in    .     pc„__::    F.       A    c.i_-  cr:.y  iior.    of    the    prograi     c  found    in 

the    '  on   Pr;  t  _   /360   _  c:  er  tif  ic    Subrouting 

p    f:uaVaa     -S6GA-CM-02X)    Version   J  I    k  iplice  t    on    r ascription 

it     .'     sm   subroutine   —    -   ■  .       -•    lis  ting    of 
....  S,         &SPS    uses    th< 
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S?  array  an  The  SI  array  contains 

time!     whic  :'.  <     '  in  a  jrial,  and  SP  contains 

the  s  .,     -.  -  ■  ~r.t  steps.   The  step  ch* 

obtained  fr  ...  the  f:  s-.t:;  number  of  steps 

trial*   If  Che  errc  :  array  ..  is  placac  in  the  sub- 
itine,  it  calculates  the  /alues  described  by  equation  21. 
The  aaxiaun  value  of  t  is  read  into  AAEPS  from  NTAU,  ar.d  the 
maximum  value  of  v  is  NTAU  sample  points  to  the  right  or 
Left  of  the       time,   AAE  Ls  the  array  containing  the  values 
of  EAE,  and   P      -        '  of  points  in  -his  array. 

7  shows  the  results  obtained  from  CROSS  and  AAEPS 
for  six  different  trials.   The  value  of  the  maximum  time 
shift  Ct)  fed  into  bosh  p  s  ten  sample  points  which 
one-half  th    rell  times  contained  in  the  target  signal. 
la  2  lists   )Be  of  she  points  obtained  from  Figure  7  along 
wit           age   rror  and  RMS  error.   All  of  the  trials 
scored  were  obtained  from  the  same  target  signal  so  a  compar- 
ison oi        a  be  m< 

The  f: ■-    result  that  can  be  obtained  from  Figure  7  is 

that  for  ail  of  the  trials  except  2X11  the  ;,  ___(t)  versus  t 
curv,  a       les  3  constant  as  T  appro......  i  -10  and  +10  which 

correspc  ds  to  -d/2  _t,C  +       This  shows  that  for  all  of  the 

■_■_-; :   .11  it  was  valid  so  assume  that  the  second 

..  s.:  „quation  17  was  ie;  Lgi'sle    If  the  second  term  was 

not  ._  li  ib     the  - or     (t)  n        -  -.or:::-  for  large 

ive  t  .-     urease  for  larg  t.   The  reason 
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2X11  does  not  show  this  is  because  the  subject  had  no  idea  of 
what  the  target  pattern  was;  and  therefore,  could  not  antici- 
pate on  any  of  the  steps..   Subject  2X11  would  be  considered 
a  poor  tracker  at  the  tine  this  trial  was  obtained. 

A  comparison  of  the  values  lieted  for  <♦>   (0)  and  the 
average  error  on  Table  2  shows  that  the  value  of  §       (0)  may 
be  a  function  of  the  average  error.   A  statement  to  this 
effect  can  not  be  made  with  any  certainty  because  this  value 
of  <j>   (t)  was  not  completely  analyzed  mathematically  and  there 
was  not  enough  data  scored  to  confirm  this  result.   The  only 
aspect  of  £   (0)  that  is  confirmed  is  that  this  point  is  the 

maximum  value  of  j   (v)j 

se 

The  conclusions  obtained  from  the  mathematical  analysis 

were  that  the  difference  between  A   (0)  and  <j>   (t)  for  t  >  0 

vse         Yse 

is  a  weighted  average  of  the  error  which  exists  to  the  left  of 

T.  and  the  difference  for  t  <  0  is  a  weighted  average  of  the 

error  which  exists  to  the  right  of  T . •   An  inspection  of  the 

plots  of  <j>   CO  and  yC?)  on  Figure  7  confirm  this.   The  plot 
s  e 

of  y(t)  for  2W11  shows  that  the  maximum  average  error  exists 
to  the  right  of  T .  or  t  =  0  point  and  that  this  average  error 

to  the  right  of  T   is  small.   <£   (t)  for  2W11  shows  this  by 

—  sc 

the  fact  that  $   (d/2)  is  a  small  amount  greater  than 

s  c 

<J)ee(-d/2)«       The    plot    for    2X11    also    describes    this    by    y(x) 

showing    that    most    of    the    sv     -    ge    error    exists    to    the    right    of 

T      and    4       (-d/2)     <<    <j>       (d/2).       Therefore,    <?       (d/2)    -    <?       (-d/2) 
-  se  se  se 

cates    the    relative    amount    of    error    which    exists    to    the 


left    or    right    of   T 
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The  magnitude  of  the  error  which  exists  to  the  right  or 

left  of  T.  is  indicated  by  <j>   (0)  -  <j>   C-d/2)  and  i,       (0)  - 
i  se        se  se 

<J>   (+d/2)  respectively.   This  can  be  seen  by  comparing  the 

plots  for  3T11  and  3U10.   i^Ct)  shows  that  the  average  amount 

of  error  to  the  right  of  T.  for  3U10  is  greater  than  the 

amount  for  3T11.  6       (0)  -  6       (-d/2)  for  3U10  is  greater  than 

se        se 

<j>   (0)  -  <j>   (-d/2)  for  3T11.   On  the  other  hand  the  average 
se        se 

amount  of  error  to  the  left  of  T.  for  3U10  is  less  than  the 

1 

amount    for    3T11    and    <{»       (0)    -    <>       (d/2)    for    3U10    is    less    than 

se  se 

4>       (0)    -    4>       (d/2)     for    3T11. 
se  se 

C.   CONCLUSIONS 

In  conclusion  the  following  remarks  can  be  obtained  from 
this  research: 

1.  The  best  computerized  scoring  procedures  for  the 
human  tracker  are  the  procedures  that  do  not  require 
decisions  made  by  the  computer  and  the  procedures 
that  do  not  depend  on  the  quality  of  the  tracker. 

2.  The  RMS  error  gives  pertinent  information  about 
the  human  tracker  and  should  be  incorporated  into 
the  Motor  Skills  system  along  with  the  IES. 

3.  The  indices  obtained  from  SCORE  are  very  useful  as 
long  as  the  limitations  of  the  decisions  made  by 
the  computer  on  lead-lag  and  overshoot-undershoot 
are  kept  in'  mind. 

4.  The  cross  correlation  of  the  target  signal  with 
the  error  signal  (  £   (t))  evaluated  at  zero  may  be 


a  function  of  the  average  error.   The  difference 

between  <>   (0)  and  <j>   (t)  for  x    >    0  is  a  weighted 
se  s^ 

average  of  the  error  which  exists  to  the  left  of 
Ti#  and  the  difference  for  t  <  0  is  a  weighted 
average  of  the  error  which  exists  to  the  right  of 
T^.   The  cross  correlation  of  the  target  signal 
and  the  error  signal  could  be  implemented  into  the 
Motor  Skills  system,  and  it  would  be  very  valuable 
in  scoring  the  human  tracker. 

5.  The  ensemble  average  of  the  absolute  value  of  the 
error  around  the  step  change  gives  valuable  informa- 
tion about  the  human  tracker,  but  the  availability 
of  the  equipment  to  implement  this  into  the  Motor 
Skills  system  is  uncertain. 

6.  Future  studies  in  this  area  are  recommended.   It 
has  been  established  that  the  cross  correlation  of 
the  target  signal  with  the  error  signal  can  be  used 
to  score  the  human  tracker,  but  the  relative  meaning 
of  the  scores  obtained  has  not  been  established. 
Therefore,  it  is  recommended  that  the  mathematical 
analysis  be  extended  to  find  the  relationship 
between  i   (t)  and  the  level  of  performance  of  the 
trackers,  and  that  any  results  be  checked  experi- 
mentally.  Also,  it  is  suggested  that  this  analysis 
be  applied  to  the  ramp  tracking  task. 
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APPENDIX  A 
SUBROUTINE  TANOST 


SUBROUTINE  TANCST(TG»NPTS»ZERC»CNE»TWC»THREE>FCUR.FIVE»SIX, 
1SEVEN) 
DIMENSION  TG( 1100  )  ,STEP(  10)  ,STM(10  )  ,KE(1G00) 

1  FORMAT (  ERRCR=  .16) 

2  FORMAT (  NUMBER  OF  ERRORS  IS  GREATER  THAN  20  -  NUMBER  =  ,16) 
N  =  0 

3  FORMAT (  KE(  ,14,  )=  ,15) 

4  IF(ZFR0)5,1G,5 

5  N=N+1 
STEP(N)=0. 

10  IF (ONE) 15,20, 15 
15  N=N+1 

STEP(N)=.43 
20  IF(TWO)25,3C,25 
25  N=N+1 

STEP(N)=.86 
30  IF(THREE)35»40,35 
35  N=N+1 

STEP(N)=1.29 
40  IF(FGUR)45,50,45 

4  5  N=N+1 

STEP (N) =1.72 
50  IF(FIVE)55,60,55 

5  5  N=N+1 

STEP(N)=2„15 
60  IF(SIX)65,70,65 

6  5  N=N+1 

STEP(N)=2.58 
70  IF<SEVEN)75,80,75 

7  5  N=N+1 

STEP (N) =3.0 

8  0  MSP=N-1 

DO  81  I=1,NCP 
81  STM( I )=(STEf  ( I )+STEP( 1+1) )/2. 

IF(TG(1 ) )82,83,83 
32  SGN=-1. 

GO  TO  84 

83  SGN=1. 

84  DO  85  1=1, NSP 

IF(ABS(TG< 1)  )-STM( I )  )  8 7, 8 5,  8 5 
55  CONTINUE 

86  TG( i)=SGN*STEP(NSP+l 5 

GO  TO  90 
37  TG( 1 )=SGN*STEP( I ) 
90  DO  200  N=2,NPTS 
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94 

96 
10\ 

102 
105 

110 

120 

200 


210 
215 

220 
230 
235 


240 
300 


410 

411 
412 
413 


414 


415 


420 


425 


IF(ABS(TG(N)-TG(N-1 ) )-.2)94,94,96 
TG(N)=TG(N-1 ) 

GO  TO  200 

IF(TG(N)  )  101  ,102*102 

SNG=-1. 

GO  TO  105 

SNG=1. 

DC  120  1=1 ,NSP 

IF(ABS(TG(N)  )-STM(  I)  )  110.110,120 

Tr.(N)=SNG*STEP(  I  ) 

GO  TC  200 

CONTINUE 

TG(N)=SNG*STEP(NSP+1 ) 

CONTINUE 

1=0 

GP=TG(1 ) 

NPT=NPTS-2 

DC  300  N=2.NPT 

IF(TG(N)-GP)210,300,210 

IF(GP-TG(N+1 ))220,215,220 

TG(N)=GP 

L.C  TC  300 

IF(TG(N+1)-7G(N))2  35,230,235 

IF(TG(N  +  2)-TG(N) ) 2 35, 240,  2 35 

1  =  1  +  1 

KE( I )=N 

WRITE (3, 3)  I,N 

GC  TC  300 

GP=TG(N) 

CONTINUE 

KE(  I+1)=KE(  I  J  +  10 

I  1  =  1 

DC  600  N=l ,1 

IF  (KE(N)+1-KE(N+1) )411,410,600 

I  1  =  11  +  1 
GC  TC  600 

IF( 11-9)420,420,412 

IF( 11-20)413,413,415 

NUM=KE(N) 

NBF=NUM-II+1 

DC  414  LL=NBF,NUM 

WRITE(2,1)  LL 

II  =  1 

GC  TC  600 

WRITE (3, 2)  KE(N) 

I  1  =  1 

GC  TC  600 

NUM=KE(N) 

N *F=KE(N) +1 

NoF=KE(N)-I I 

IF( I  1-1 5445,425,445 

BF=ABS(TG(NUM)-TG(NBF) ) 
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430 

435 
440 

445 

45  0 
455 


460 
500 
510 


520 


599 
60  0 


IF! 

TG< 

GO 

TG( 

I  1  = 

GO 

DC 

IF( 

DC 

TG< 

NAF 

GC 

CCN 

IF( 

TG( 

NAF 

IFi 

TG{ 

NBF 

GC  T: 


ARS(TG(NUM)-TG(NAF) ) 

3F-AF ) 430,435*435 

NUM)=TG(NBF) 

TC  440 

NUM)=TG<NAF) 

1 

TC  600 


460 

TG{M 
455 
MM  )  = 
=  M 


M=NBF»NUM 

)-TG(NAF)  )460  ,450»460 

MM=M»NUM 

TG(NAF) 

TC  500 

TINUE 

NAF-NBF-1 ) 599,599,510 

NAF-1)=TG{NAF) 

=NAF-1 

NAF-NBF-1 ) 599,5  99,520 
NBF+1=TG{NBF) 
=NBF+1 
00 


I  1  = 
CCN 
RET 

END 
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TINUI 
URN 


APPENDIX  B 
SUBROUTINE  CUNO 


10 

12 

14 

16 

13 

20 

22 

100 

SUBROUTINE  CUNO  (CR»N?TS) 

DIMENSION  CR(llOO) 

IF( <CR(2)+10. )-(CR(l )+10.) )1,2»2 

SGN=-1. 

GO  TO  3 

SGN=1. 

NN=NPTS-1 

D~  100  N=2,NN 

IF( (CR(N)+10.)-(CR(N-1)+10.) )  4,6,6 

IFiSGN) 10  0,8,8 

IF(SGN)8,10u,100 

AV1=(CR(N+1)+CR(N-1) )*.5 

AV2=(CR(N )+CR(N-2 ) )*.5 

D1=ABS(AVI-CR(N) ) 

D2=ABS(AV2-CR(N-1) 5 

IF(D1-D2) 10,12,12 

IF(D2-.2) 18,14,14 

IF(Dl-.2) 18,16,16 

^R(N-1)=AV2 


UO  T 


15 


CR(N)=AV1 

IF((CR(N)+10.)-(CR(N-1)+1'0.))  20*22,22 

SGN=-1. 

GO  TO  100 

SGN=1. 

CONTINUE 

RETURN 

END 


APPENDIX  C 

SUBROUTINE  SCORE 
FLOW  CHART 


(START) 

6 

'i 


8  17 

INITIALIZE  PROGRAM  VARAbLES 


V 


18  19 

GENERATE    MID-POINTS    j 


: 

20 

2b 

SET  TL 

AND  TA 

ARRAYS 

TO  ZERO 

SO  THE 

PRESENCE 

OF  THE 

DIFFERENT 

VALUES 

CAN  BE 

CHECKED  LATER 

28 

DO 
N=2»NP 

1 

v 


30 
ES=(S(N)+10o)-(S(N-l)+10.) 


102 
D=lc! 


\    GO    TO    700/ 


1041 
D=-l. 


106 
M  =  M+1 


107 
ST(M)=N 


7 


108 
TT(M-1  )=TD/(TS(N'.)-TS(M-1  )  ) 


:■" 


/FFOM    850\ 


109 
TD  =  0» 

T 


\go  to   ?oc/ 


65 


40  0 
1  =  0 


\GC  TO  500  / 


406 
1=0 


420 
TL(M)=N+I 

V 

\GC  TO  700  / 


66 


\ GC    TO    620  / 


620 
TA(M)=N-I 

v       I 

XT 

GC    TC    700  / 

67 


700 
=AB5(S(N)-C(N) 


'         740         ' 
DC 
KK=1*4  t 

742 

K  =  K  +  1 

C       750        "\ 

V  CCNTINUEV~~~ 


752 
K  =  6 


_: 


800 
TEI  CO=TEI  CO+1  1 


802 
ERR=ERR+F 


804 
|5ERR=SERR+E**2 


G 


TO  2S) 

1 

I 

! 
•  • 

I 

i 


; ^  _  r        850    "\ 


68 


85] 

8  55 

RECORD  THE 

NUMBER  OF 

STEPS  SCORED 

(NO 

TEP) 

CALCl  LATE 

THE 

AVERAGE 

ERROR 

(AERR) 

CALCULATE 

THE 

RMS  ERR 

OR  (RMSE) 

CALCULATE 

THE 

PERCENT 

ERROR 

FOR  EACH 

ERROR  INTERVAL 

(  P  T  E  I  ) 

857 

CONVERT  ALL  RFCORED  VALUES  OF  TIME  S! 
THAT  THE  VALUES  CORRFSPONDS  TO  THE 
ORIGINAL  SAMPLING  RATE 

ORIGINAL  =  .5*<TIME)+.5 
NOTE — IF  A  VALUE  WAS  ZERO  IT  IS  .5  Hi 


■~ 


861 

CHECK  FO 

—  IF  EI 

TA(M) 


870 


R  TIME  LEAVE  AND  TIME  ARRIVE 
THER  IS  EQUAL  TO  .5  SET  TL(M)=( 
=0,  ZL(M)=77.7  AND  TR(M)=77.7 
—  IF  BOTH  ARE  PRESENT  FIND  ZL(M)  AND 


TR(M) 
THE 


N  J=ST(M) 

SP(M)=TG( J! 


884 
C=-l 


(GO  TO  9o£ 


y 


882 
C=+l. 


-,  o  ^   I  ,_,  BO 


86V 


69 


902 
K  =  J-I 


1 

I 

[  904 
1  1=0 

• 

908 
1  =  1  +  1 

U(M)=D»(CR(K+I )-TG(K+I ) 


(GO  TO  860) 

1 

0 


912 
TOU=K+I 


/    950   "N 

VCONTINUF  ) 


1 

r"0 

952      960 

PRINT 

INDICES 

1000 

♦ 

RET 

EN 

JKIM 

5 
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appendix  d 
subroutine  score 

arguments 

tg target  array 

cr cursor  array 

elevel array  of  error  levels 

'  elevel( 1) =value  of  error  level  one 

« 

ELEVEL(5)=VALUE  CF    ERROR  LEVEL  FIVE 

DL.EVEL VALUE  OF  TIME  ON  TARGET  LEVEL 

NPTS NUMBER  OF  POINTS  IN  THE  TARGET  AND  CURSOR  ARRAYS 

ST ARRAY  CONTAINING  THE  TIMES  AT  WHICH  THE  DIFFERENT 

STEPS  OCCUR 

TL ARRAY  CONTAINING  THE  TIMES  AT  WHICH  THE  CURSOR  LEAVES 

ERROR  LEVEL  ONE  OF  THE  PREVIOUS  STEP 

Ta ARRAY  CONTAINING  THF  TIMES  AT  WHICH  THE  CURSOR  ARRIVES 

AT  ERROR  LEVEL  ONE  OF  THE  NEXT  STEP 

TT ARRAY  CONTAINING  THE  TIME  ON  TARGET  FOR  EACH  STEP 

ZL ARRAY  CONTAINING  THE  LEAD-LAG  FOR  EACH  STEP 

TR ARRAY  CONTAINING  THE  TIME  OF  RESPONSE  FOR  EACH  STRP 

Sp ARRAY  CONTAINING  THE  STEP  POSITION  FOR  EACH  STEP 

OH ARRAY  CONTAINING  THE  OVERSHOOT-UNDERSHOOT  FOR  EACH 

STEP 

TOU ARRAY  CONTAINING  THE  TIMES  AT  WHICH  THE  OVERSHOOT- 
UNDERSHOOT  OCCURS  FOR  EACH  STEP 

NSTEP NUMBER  OF  STEPS  SCORED 

LIST PRINTING  INSTRUCT  ION 

VALUE  OF  ONE  =  PRINT  INDICES 

VALUE  OF  ZERO  =  DO  NOT  PRINT  INDICES 
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SUBROUTINE    SCORE ( TG,CR,ELEVEL ,DLEVEL,NPTS,ST ,TL .TA ,TT .ZL.TR, 
1SP,0U»T0U,NSTEP,LIST) 

[INTENSION    TG(1)  ,CR(1  )  *ST(1)  ,TL(1)  »TA(1)  ,ELEVEL(1)  ,TT(1)  ,ZL(1J 

DIMENSION    TF  ( 1 ) ,OU( 1 ) ,SP ( 1 ) . TCU < 1 ) 

DIMENSION  S(21OO),C(2100)*TEI  (6)  .PTEK6)  ,EL(6) 

1  FORMAT <  1  ,9X.  AVERAGE  ERROR  =  »F7.3»9Xt  RMS  ERROR  =  ♦FT. 3) 

2  FORMAT! 10X»  ERROR  LEVEL   »I1»-  =   »F4.1,    ) 

6  FORMAT(3X,I5»3(2X»F6.1) »3X >F4. 1 ,6X »F4. 1 , 5X.F4.2 »8X ,F5 .2 »9X , 
2F6.1,5X»F6.1 ) 

a  m=i 

D  =  l 

FRR  =  0 
SFRR=0 
TD  =  0. 
ST(  1  )=0. 
DO  1C  K=l,6 
10  TEI (K)=0. 

14  DO  15  K  =  l,5 

15  EL(K)=ELEVEL(K) 

16  EL1=ELEVEL(1) 

17  I0=-1 

18  TGCNPTS+1 )=TG(NPTS) 
CR(NPTS+1 )=CR<NPTS) 

.  J=-l 
DO  19  N=1,NPTS 
J=J  +  2 

C(J)=CR(N ) 

C( J+1)=.5*{CR(N)+CR(N+1) ) 
S ( J)=TG(N ) 

19  S(J+1)=TG(N+1) 
N!  =J 

20  DO  25  J=1,1G0 
TL( J) =0.0 

2  5  TA(J)=CO 

DC  850  N=2,  NP 

3  0  FS=(S(N)+10. )-(S(N-l)+10.) 

101  IF(FS)  10  4,700,102 

102  D=l. 

GO  TO  1C6 
104  D=-l. 

106  M=M+1 

107  £ T(M)=N 

108  TT(M-1 )=TD/( 5T(M)-ST (M-l) ) 
TD  =  G. 

200  IF  (EL1-A5S(S(N-1 )-C(N-l) ) )  300,  202,  202 
20  2  1=0 

204  IF  (EL1-ABS(S(N-1)-C(N+I ) } )  420,  420,  206 
206  1=1+1 

GO  TO  204 


ABSTRACT 

The  limitations  of  the  human  when  operating  as  part  of  a 
control  system  are  becoming  more  apparent  every  day.   This  has 
prompted  considerable  research  in  the  area  of  human  behavior 
in  control  systems.   Research  in  this  area  is  being  performed 
by  the  Psychology  Department  at  Kansas  State  University  by 
presenting  a  tracking  task  to  numerous  subjects.   The  main  de- 
ficiency in  the  present  tracking  system  is  in  the  equipment 
which  scores  the  subjects.   Therefore  this  research  was  per- 
formed to  obtain  better  scoring  methods. 

In  the  past  the  only  index  of  performance  obtained  from 
the  tracking  system  was  the  integrated  error  score  (IES) .   To 
obtain  more  information  on  a  subject  the  response  of  the  sub- 
ject was  recorded  and  other  indices  of  performance  were  measured, 
These  measurements  were  made  by  hand  which  is  time  consuming 
and  in  many  cases  called  for  the  scorer  to  make  a  judgement  on 
the  relative  scores  obtained.   To  obtain  a  better  scoring  pro- 
cedure these  indices  were  redefined  so  they  could  be  measured 
by  a  computer.   Then  a  computer  program  was  written  to  obtain 
these  redefined  indices.   Also  a  few  indices  that  had  not  been 
obtained  before  were  measured  by  the  computer. 

The  indices  obtained  by  the  computer  gave  valuable  infor- 
mation on  the  human  tracker.   Some  of  these  indices  were  lead- 
lag,  overshoot-undershoot,  average  error,  RMS  error  and  time  on 
target.   One  index  of  performance  which  was  of  special  interest 
was  the  RMS  error.   This  index  indicates  the  performance  of  a 


tracker  close  to  a  target  change.   This  index  was  of  special 
interest  because  the  RMS  error  could  be  implemented  into  the 
present  tracking  system.   The  other  indices  measured  by  the 
computer  gave  information  concerning  the  cause  of  a  certain 
IES  or  RMS  error,  but  the  equipment  required  to  obtain  these 
indices  could  not  readily  be  built  into  the  tracking  system. 

To  obtain  more  information  on  scoring  methods  for  the 
human  tracker  the  tools  used  in  communication  theory  were 
applied  to  an  assumed  mathematical  model  of  the  human  being. 
The  model  was  a  second  order  system  with  a  time  shift  placed 
at  the  input  to  simulate  a  lead  or  a  lag  in  the  response.   The 
application  of  the  tools  of  communication  theory  showed  that 
the  cross  correlation  of  the  target  signal  with  the  error  sig- 
nal gave  a  weighted  average  of  the  error  about  a  target  change 
Another  function  considered  was  the  ensemble  average  of  the 
absolute  value  of  the  error  close  to  target  change,  but 
equipment  to  obtain  the  cross  correlation  of  two  signals  is 
easier  to  obtain. 

The  conclusions  obtained  from  this  research  are  that  the 
equipment  required  to  obtain  the  RMS  error  and  the  cross  cor- 
relation of  the  target  signal  with  the  error  signal  should  be 
implemented  into  the  present  tracking  system.  The  equipment 
required  is  readily  available  and  should  not  be  too  difficult 
to  install. 


